Control apparatus and control method

ABSTRACT

Systems and methods for selective content sharing with a communication target apparatus are provided. In various aspects, communication with a communication target apparatus may be established, and content indicated by content data may be reproduced, where the reproduced content may represent audio or audio and image content. A determination may be made whether or not to share the reproduced content indicated by the content data with the communication target apparatus and a process to share or not share the reproduced content indicated by the content data with the communication target apparatus may be selectively performed. When the reproduced content is determined not to be shared with the communication target apparatus, a generated speech audio signal may be shared with the communication target apparatus while the reproduced content indicated by the content data may not shared with the communication target apparatus.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present claims priority from Japanese Priority Patent Application JP2010-219865 filed in the Japan Patent Office on Sep. 29, 2010, theentire content of which is incorporated herein by reference.

BACKGROUND

The present technology relates to a control apparatus and a controlmethod.

In recent years, for example, there have continued to spread apparatusessuch as personal computers (PCs) or the like that are capable ofestablishing communication, which relates to a telephone call betweenusers, with external apparatuses while reproducing content data.

In such a situation, a technology has been developed in which a contentis shared between a plurality of apparatuses that perform communicationrelating to a telephone call. Japanese Unexamined Patent ApplicationPublication No. 2007-36685 discloses an example of a technology thatprovides, to a plurality of users at remote locations, a realisticsensation such as a sense that they watch a video content at a samelocation.

SUMMARY

In a control apparatus (hereinafter, simply referred to as “controlapparatus of the related art”) to which a technology of the related art(hereinafter, simply referred to as “technology of the related art”) isapplied, the technology of the related art allowing a content to beshared between a plurality of apparatuses that establish communicationrelating to a telephone call, an image indicated by shared content dataand an image of a user who makes a telephone call are combined, and thecomposite image is displayed on a display screen. In addition to thedisplay of the composite image on the display screen, the controlapparatus of the related art performs sound image localization accordingto a preliminarily set position of the image of the user, with respectto speech audio relating to the telephone call. Accordingly, using thetechnology of the related art, a realistic sensation such as a sensethat users watch a video content at a same location may be provided tothe users who use individual apparatuses that establish communicationrelating to a telephone call.

Here, when communication relating to the telephone call is establishedbetween the plural apparatuses, it is not necessarily the case that auser constantly desires to share content with a communication partner.For example, in a case in which communication relating to a telephonecall is started when content data is reproduced in an apparatus, a userof the apparatus may not want a user of an apparatus that is acommunication target (hereinafter, indicated as “communication targetapparatus”) establishing communication relating to the telephone call tobe aware of the content of audio (an example of a content) indicated bythe content data the former user enjoys. Accordingly, for example, in acase in which the user of an apparatus does not desire to share, whenthe user of the communication target apparatus is aware of the contentof audio indicated by the content data the former user enjoys, theprivacy of the user of the apparatus may be invaded.

However, in the technology of the related art, for example, theprevention of such invasion of the privacy of the user as describedabove is not considered. Accordingly, even if the control apparatus ofthe related art is used, it is difficult to desire to cause a contentindicated by the content data to be selectively shared with thecommunication target apparatus with preventing the invasion of theprivacy of the user when communication relating to the telephone call isestablished with the communication target apparatus.

The present technology addresses the above-mentioned problems. Inaddition, it is desirable to provide a new and improved controlapparatus and a new and improved control method, which are capable ofcausing a content indicated by the content data to be selectively sharedwith the communication target apparatus with preventing the invasion ofthe privacy of the user when communication relating to the telephonecall is established with the communication target apparatus.

In view of the foregoing, a control apparatus for selective contentsharing with a communication target apparatus is provided. The controlapparatus may include a processor and a memory storing content data andinstructions. The instructions, when executed by the processor, maycause the processor to establish communication with a communicationtarget apparatus and reproduce content indicated by the content data,where the reproduced content may represent audio or audio and imagecontent. The instructions may also cause the processor to determinewhether or not to share the reproduced content indicated by the contentdata with the communication target apparatus and, selectively perform,in accordance with a result of the determination, a process to share ornot share the reproduced content indicated by the content data with thecommunication target apparatus. When the reproduced content indicated bythe content data is determined not to be shared with the communicationtarget apparatus, a generated speech audio signal may be shared with thecommunication target apparatus and the reproduced content indicated bythe content data may not shared with the communication target apparatus.When the reproduced content indicated by the content data is determinedto be shared with the communication target apparatus, the generatedspeech audio signal may be shared with the communication targetapparatus and the reproduced content indicated by the content data mayalso shared with the communication target apparatus.

In another aspect, the processor may be configured to add an invertedcontent audio signal to the audio represented by the reproduced content.In one embodiment, the inverted content audio signal may be obtained byinverting a phase of the audio represented by the reproduced content.

In yet another aspect, processor may be configured to mask the imagerepresented by the reproduced content. In one embodiment, the processormay mask the image represented by the reproduced content by removing aportion of the image represented by the reproduced content. In anotherembodiment, the processor may masks the image represented by thereproduced content by adding a mosaic to a portion of the imagerepresented by the reproduced content.

In another aspect, the generated speech audio signal that is shared bythe control apparatus with the communication target apparatus mayinclude a signal representing speech received from a user of the controlapparatus.

In a further aspect, the processor in the control apparatus may beconfigured to add an inverted speech audio signal to the generatedspeech audio signal shared with the communication target apparatus. Inone embodiment, the inverted speech audio signal may be obtained byinverting a phase of a speech signal received from a user of thecommunication target apparatus.

In yet another aspect, the control apparatus may include an input unitfor receiving a captured image and the processor may be configured toshare the captured image with the communication target apparatus. In oneembodiment, the processor in the control apparatus may modify thecaptured image received by the input unit and share the modifiedcaptured image with the communication target apparatus. In oneembodiment, the captured image may be modified by replacing a portion ofthe captured image with an avatar.

In still another aspect, the control apparatus may include a display andthe processor may be configured to display the captured image and theimage represented by the reproduced content to a user on the display. Inone embodiment, the processor may display the captured image and theimage represented by the reproduced content to the user in differentregions of the display. In a yet another embodiment, the differentregions in which the captured image and the image represented by thereproduced content are displayed may provide visual notification to theuser that the captured image is being shared with the communicationtarget apparatus and that the image represented by the reproducedcontent is not being shared with the communication target apparatus.

In yet another aspect, the processor in the control apparatus may beconfigured to modify the audio represented by the reproduced content. Inone embodiment, the processor may modify the audio represented by thereproduced content by adding a reverberant sound effect to the audiorepresented by the reproduced content.

In various aspects, the control apparatus may be implemented in atelephone, computer, set top box, mobile phone, or game machine.

A non-transitory computer-readable medium on which computer readableinstructions of a program are stored is provided. The instructions, whenexecuted by a processor, may cause the processor to establishcommunication with a communication target apparatus and reproducecontent indicated by content data, where the reproduced contentrepresents audio or audio and image data. The instructions may furtherconfigure the processor to determine whether or not to share thereproduced content indicated by the content data with the communicationtarget apparatus and selectively perform, in accordance with a result ofthe determination, a process to share or not share the reproducedcontent indicated by the content data with the communication targetapparatus. When the reproduced content indicated by the content data isdetermined not to be shared with the communication target apparatus, agenerated speech audio signal may be shared with the communicationtarget apparatus while the reproduced content indicated by the contentdata may not shared with the communication target apparatus. When thereproduced content indicated by the content data is determined to beshared with the communication target apparatus, the generated speechaudio signal may be shared with the communication target apparatus andthe reproduced content indicated by the content data may also sharedwith the communication target apparatus.

A method for performing selective content sharing is provided. Themethod may include establishing communication with a communicationtarget apparatus and reproducing content indicated by content data,where the reproduced content represents audio or audio and imagecontent. The method may further include determining, with a processor,whether or not to share the reproduced content indicated by the contentdata with the communication target apparatus and selectively performing,in accordance with a result of the determining, a process for sharing ornot sharing the reproduced content indicated by the content data withthe communication target apparatus. When the reproduced contentindicated by the content data is determined not to be shared with thecommunication target apparatus, the method may include sharing agenerated speech audio signal with the communication target apparatusand not sharing the reproduced content indicated by the content datawith the communication target apparatus. When the reproduced contentindicated by the content data is determined to be shared with thecommunication target apparatus, the method may include sharing thegenerated speech audio signal with the communication target apparatusand sharing the reproduced content indicated by the content data withthe communication target apparatus.

Using such systems and methods, it is possible to cause a contentindicated by the content data to be selectively shared with thecommunication target apparatus with preventing the invasion of theprivacy of a user when communication relating to a telephone call isestablished with the communication target apparatus.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is an explanatory diagram for explaining the summary of a contentsharing approach in a control apparatus according to an embodiment ofthe present technology.

FIG. 2 is an explanatory diagram illustrating an example of a displayimage that the control apparatus according to an embodiment of thepresent technology causes to be displayed on a display screen in acontent non-sharing state.

FIG. 3 is an explanatory diagram illustrating an example of a displayimage that the control apparatus according to an embodiment of thepresent technology causes to be displayed on a display screen in acontent sharing state.

FIG. 4 is a flowchart illustrating an example of processing according tothe content sharing approach in the control apparatus according to anembodiment of the present technology.

FIG. 5 is a block diagram illustrating an example of a configuration ofa control apparatus according to a first embodiment of the presenttechnology.

FIG. 6 is an explanatory diagram illustrating an example of a hardwareconfiguration of the control apparatus according to an embodiment of thepresent technology.

FIG. 7 is a block diagram illustrating an example of a configuration ofa control apparatus according to a second embodiment of the presenttechnology.

DETAILED DESCRIPTION OF EMBODIMENTS

Hereinafter, preferred embodiments of the present technology will bedescribed in detail with reference to figures. In addition, in thepresent specification and figures, a same symbol is assigned to aconfiguration element having a practically same functionalconfiguration, and hence the duplicative description thereof will beomitted.

In addition, hereinafter, the description will be performed in thefollowing order.

1. Approach According to Embodiment of Present Technology

2. Control Device According to Embodiment of Present Technology

3. Program According to Embodiment of Present Technology

(Approach According to Embodiment of Present Technology)

Before the description of the configuration of a control apparatus(hereinafter, indicated as “control apparatus 100” in some cases)according to an embodiment of the present technology, a content sharingapproach according to an embodiment of the present technology will bedescribed. In addition, processing according to the content sharingapproach according to an embodiment of the present technology, describedas follows, may be treated as processing according to a control methodaccording to an embodiment of the present technology.

In addition, hereinafter, a case in which the control apparatus 100performs, in parallel, processing according to the reproduction ofcontent data and processing according to a telephone call made betweenthe control apparatus 100 and one or more communication targetapparatuses will be cited as an example and described. Here, the term“content data” according to an embodiment of the present technology isdata indicating audio or audio and an image (moving image/still image).Hereinafter, in some case, the reproduced audio or audio and an image,indicated by content data, are collectively indicated as “content”. Forexample, music data, video data, or the like may be cited as the contentdata. In addition, while, for example, the control apparatus 100reproduces content data stored in a storage unit (described later) orcontent data received from an external apparatus such as a server or thelike, content data reproduced by the control apparatus 100 is notlimited to such examples as described above. For example, by receiving(directly, or indirectly through an antenna, a tuner, or the like) abroadcast wave transmitted from a television tower or the like, thecontrol apparatus 100 can also obtain content data from the outside andreproduce the content data.

In addition, while, as communication relating to a telephone callaccording to an embodiment of the present technology, for example,communication relating to a telephone call based on audio may be cited,the communication relating to a telephone call according to anembodiment of the present technology is not limited to such an exampleas described above. For example, the communication relating to atelephone call according to an embodiment of the present technology maybe communication relating to a telephone call (for example, a videotelephone call) based on a captured image and audio. In addition, thecommunication relating to a telephone call according to an embodiment ofthe present technology may be communication relating to a telephone callbased on a still image and audio. Here, the term “captured image”according to an embodiment of the present technology is a moving image(or, the aggregate of still images successively captured in a temporalaxis direction) captured by imaging. In addition, in communicationrelating to a telephone call (for example, a video telephone call) basedon a captured image and audio, made between the control apparatus 100according to an embodiment of the present technology and a communicationtarget apparatus, an image in which an imaged user included in acaptured image is replaced with another character (so-called avatar) maybe transmitted and received, as a captured image, between the controlapparatus 100 and the communication target apparatus.

[Summary of Content Sharing Approach]

A same content is shared between a control apparatus and a communicationtarget apparatus, for example, in such a way as in a case in which thetechnology of the related art is used, and hence it is possible for auser of the control apparatus and a user of the communication targetapparatus to enjoy the same content while making a telephone call.Namely, the same content is shared between the control apparatus and thecommunication target apparatus, and hence it is possible to provide, tothe users, a sense that they enjoy the content at a same location evenif the control apparatus and the communication target apparatus arelocated at remote locations. Accordingly, the same content is sharedbetween the control apparatus and the communication target apparatus,and hence it is possible to improve convenience for the users.

On the other hand, as described above, for example, in a case in whichthe user of the control apparatus does not desire to share a content,when the user of the communication target apparatus is aware of thecontent of audio indicated by the content data the former user enjoys,the privacy of the user of the control apparatus may be invaded.

Accordingly, on the basis of the reproduction state of content data, thecontrol apparatus 100 according to an embodiment of the presenttechnology selectively performs processing (hereinafter, indicated as“content sharing processing” in some cases) according to sharing of acontent indicated by the content data or processing (hereinafter,indicated as “content non-sharing processing” in some cases) forpreventing a content indicated by reproduced content data from beingshared with the communication target apparatus.

More specifically, the control apparatus 100 determines whether or notthe content indicated by the content data is to be shared with thecommunication target apparatus. In addition, when, in theabove-mentioned determination, it is determined that the contentindicated by the content data is to be shared, the control apparatus 100selectively performs the content sharing processing. In addition, when,in the above-mentioned determination, it is not determined that thecontent indicated by the content data is to be shared, the controlapparatus 100 control apparatus 100 performs the content non-sharingprocessing.

FIG. 1 is an explanatory diagram for explaining the summary of a contentsharing approach in the control apparatus 100 according to an embodimentof the present technology. Here, FIG. 1 illustrates the reproductionstate of content data in the control apparatus 100 and the summary ofprocessing relating to content data reproduction performed in eachreproduction state, when the control apparatus 100 establishescommunication relating to a telephone call with a communication targetapparatus.

As illustrated in FIG. 1, when the control apparatus 100 establishescommunication relating to a telephone call with the communication targetapparatus, the control apparatus 100 selectively performs processingindicated in (1) to processing indicated in (3), illustrated as follows,as processing relating to content data reproduction, in response tothree reproduction states illustrated in A in FIG. 1 to C in FIG. 1, forexample.

(1) Processing Performed when No Content Data is Reproduced (ProcessingPerformed in State A Illustrated in FIG. 1)

When no content data is reproduced, the control apparatus 100 transmitsto the communication target apparatus an audio signal (hereinafter,indicated as “generated audio signal” in some cases) generated by anaudio input device (audio input unit described later) included the selfapparatus or an external audio input device (audio input apparatusdescribed later), for example.

Here, the audio input device or the external audio input device is adevice that a user of the control apparatus 100 (hereinafter, simplyindicated as “user” in some cases) uses for making a telephone call to auser of the communication target apparatus. Namely, the generated audiosignal according to an embodiment of the present technology includes anaudio signal (hereinafter, referred to as “speech audio signal”)corresponding to the speech audio of the user relating to the telephonecall. Accordingly, by transmitting the generated audio signal to thecommunication target apparatus in communication relating to thetelephone call, the control apparatus 100 can present the speech audiorelating to the telephone call to the user of the communication targetapparatus.

In addition, the audio signal included in the generated audio signalaccording to an embodiment of the present technology is not limited tothe speech audio signal corresponding to the speech audio of the user.For example, the generated audio signal may include an audio signal(hereinafter, indicated as “output audio signal” in some cases)corresponding to audio output from an audio input device (audio outputunit described later) included the self apparatus or an external audioinput device (audio output apparatus described later). Morespecifically, for example, when the control apparatus 100 reproduces nocontent data, the generated audio signal may include, as an output audiosignal, an audio signal (hereinafter, referred to as “external speechaudio signal”) corresponding to the speech audio of the user of thecommunication target apparatus relating to a telephone call, the audiosignal being received by the control apparatus 100 from thecommunication target apparatus.

Here, when the control apparatus 100 transmits to the communicationtarget apparatus the generated audio signal including the externalspeech audio signal, it may happen that the user of the communicationtarget apparatus hears the speech audio made by the user of thecommunication target apparatus, in addition to the speech audio of theuser of the control apparatus 100, for example.

Therefore, for example, the control apparatus 100 adds an invertedexternal speech audio signal, obtained by inverting the phase of theexternal speech audio signal, to the generated audio signal, andtransmits, to the communication target apparatus, the generated audiosignal to which the inverted external speech audio signal is added. Forexample, in such a way as described above, by transmitting, to thecommunication target apparatus, the generated audio signal to which theinverted external speech audio signal is added, the control apparatus100 can prevent the user of the communication target apparatus fromhearing the speech audio made by the user of the communication targetapparatus.

Here, for example, the control apparatus 100 includes an adaptive filtersuch as Least Mean Square (LMS) or the like or an adder, and therebyperforms the above-mentioned processing on the generated audio signal.In addition, a configuration used for realizing the above-mentionedprocessing for the generated audio signal, performed in the controlapparatus 100 according to an embodiment of the present technology, isnot limited to the above-mentioned example. For example, the controlapparatus 100 includes an arbitrary configuration capable of realizingso-called echo cancellation, and thereby can realize the above-mentionedprocessing for the generated audio signal.

(2) Processing Performed when No Content Indicated by Reproduced ContentData is Shared (Content Non-Sharing Processing: Processing Performed inState B Illustrated in FIG. 1)

When no content indicated by reproduced content data is shared, thecontrol apparatus 100 causes the speech audio signal to be transmittedto the communication target apparatus, and does not cause a reproducedaudio signal (hereinafter, indicated as “content audio signal” in somecases) corresponding to audio indicated by the reproduced content datato be transmitted to the communication target apparatus.

As described above, the generated audio signal generated by the audioinput device or the external audio input device is not limited to thespeech audio signal corresponding to the speech audio of the user, andmay include the output audio signal. In addition, when the controlapparatus 100 reproduces content data, the output audio signal turns outto include the content audio signal. Here, when the control apparatus100 transmits the generated audio signal including the content audiosignal to the communication target apparatus, the user of thecommunication target apparatus hears audio indicated by the content datareproduced in the control apparatus 100, in addition to the speech audioof the user of the control apparatus 100, for example. Accordingly, whenthe generated audio signal including the content audio signal istransmitted to the communication target apparatus as described above,the privacy of the user may be invaded.

Therefore, for example, the control apparatus 100 adds an invertedcontent audio signal, obtained by inverting the phase of the contentaudio signal, to the generated audio signal, and transmits, to thecommunication target apparatus, the generated audio signal to which theinverted content audio signal is added. For example, in such a way asdescribed above, by transmitting, to the communication target apparatus,the generated audio signal to which the inverted content audio signal isadded, the control apparatus 100 can prevent the user of thecommunication target apparatus from hearing audio indicated by thecontent data reproduced in the control apparatus 100.

Here, for example, the control apparatus 100 includes an adaptive filtersuch as LMS or the like or an adder, and thereby performs theabove-mentioned processing on the generated audio signal. In addition,the control apparatus 100 includes an arbitrary configuration capable ofrealizing so-called echo cancellation, and thereby can realize theabove-mentioned processing for the generated audio signal.

In addition, in the same way as in the above-mentioned case (1), forexample, the control apparatus 100 may further add the inverted externalspeech audio signal, obtained by inverting the phase of the externalspeech audio signal, to the generated audio signal, and transmit, to thecommunication target apparatus, the generated audio signal to which theinverted external speech audio signal is further added. For example, insuch a way as described above, by transmitting, to the communicationtarget apparatus, the generated audio signal to which the invertedexternal speech audio signal is further added, the control apparatus 100can further prevent the user of the communication target apparatus fromhearing the speech audio made by the user of the communication targetapparatus.

For example, in such a way as described above, by transmitting, to thecommunication target apparatus, the generated audio signal to which theinverted content audio signal is added, the control apparatus 100 causesthe speech audio signal to be transmitted to the communication targetapparatus, and does not cause the content audio signal corresponding tothe reproduced content data to be transmitted to the communicationtarget apparatus. Accordingly, since the control apparatus 100 canprevent the user of the communication target apparatus from hearingaudio indicated by the content data reproduced in the control apparatus100, the control apparatus 100 can prevent the privacy of the user frombeing invaded.

In addition, when the control apparatus 100 establishes communicationrelating to a telephone call (for example, a video telephone call) basedon a captured image and audio with the communication target apparatus,the control apparatus 100 prevents the privacy of the user from beinginvaded, by performing image processing on a captured image generated byan imaging device (imaging unit described later) included in the selfapparatus or an external imaging device (imaging apparatus describedlater), for example. More specifically, the control apparatus 100determines whether or not an image indicated by the reproduced contentdata is included in the captured image. In addition, when the image isincluded in the captured image, the control apparatus 100 performs imageprocessing on an image portion (for example, the reflection of an imagein a window or the like), which is indicated by the content data andincluded in the captured image. For example, while, as the imageprocessing, processing for removing the image portion or mosaicprocessing may be cited, the above-mentioned image processing is notlimited to the above-mentioned examples. For example, the controlapparatus 100 may perform, as the above-mentioned image processing,arbitrary processing capable of masking the image portion which isindicated by the content data and included in the captured image.

In addition, for example, the control apparatus 100 visually notifiesthe user that a reproduction state in the control apparatus 100 is thecontent non-sharing state. FIG. 2 is an explanatory diagram illustratingan example of a display image that the control apparatus 100 accordingto an embodiment of the present technology causes to be displayed on adisplay screen in the content non-sharing state. Here, FIG. 2illustrates an example of a display image when the control apparatus 100and two communication target apparatuses establish communication, whichrelates to a telephone call (for example, a video telephone call) basedon a captured image and audio, with one another. In addition, forexample, the control apparatus 100 may cause the display image to bedisplayed on a display screen of a display device (display unitdescribed later) included the self apparatus or cause the display imageto be displayed on a display screen of an external display device(display apparatus described later) (hereinafter, in the same way).

As illustrated in FIG. 2, for example, the control apparatus 100 causesthe display image to be displayed on the display screen, the displayimage being an image in which a region A used for displaying an image (Din FIG. 2) indicated by the content data and a region B used fordisplaying captured images (E and F in FIG. 2) transmitted from thecommunication target apparatuses and received by the control apparatus100 are separated from each other. As illustrated in FIG. 2, the displayimage in which the region A and the region B are separated from eachother is displayed on the display screen, and thereby the user canvisually recognize the content non-sharing state. In addition, it shouldbe understood that the display image that the control apparatus 100causes to be displayed on the display screen in the content non-sharingstate is not limited to the example illustrated in FIG. 2.

Here, for example, on the basis of an image (for example, D in FIG. 2)indicated by the content data and captured images (for example, E and Fin FIG. 2), the control apparatus 100 generates the display image usinga method such as Picture In Picture (PIP), Picture On Picture (POP), orthe like and causes the display image to be displayed, for example. Inaddition, a generation method used for the display image in the controlapparatus 100 according to an embodiment of the present technology isnot limited to the above-mentioned example.

(3) Processing Performed when Content Indicated by Reproduced ContentData is Shared (Content Sharing Processing: Processing Performed inState C Illustrated in FIG. 1)

When a content indicated by reproduced content data is shared, thecontrol apparatus 100 transmits, to the communication target apparatus,the generated audio signal generated by the audio input device or theexternal audio input device.

Here, since a content sharing state (C illustrated in FIG. 1) is a statein which a same content is shared between the user and the user of thecommunication target apparatus, the invasion of privacy may not occureven if the content audio signal indicating audio indicated by thecontent data reproduced by the control apparatus 100 is transmitted tothe communication target apparatus. Accordingly, in the content sharingstate, the control apparatus 100 does not perform processing for addingthe inverted content audio signal to the generated audio signal in sucha way as in the processing (content non-sharing processing) illustratedin the above-mentioned (2). In addition, in the same way as in theabove-mentioned case (1), for example, the control apparatus 100 mayfurther add the inverted external speech audio signal, obtained byinverting the phase of the external speech audio signal, to thegenerated audio signal, and transmit, to the communication targetapparatus, the generated audio signal to which the inverted externalspeech audio signal is further added.

In addition, for example, the control apparatus 100 visually notifiesthe user that a reproduction state in the control apparatus 100 is thecontent sharing state. FIG. 3 is an explanatory diagram illustrating anexample of a display image that the control apparatus 100 according toan embodiment of the present technology causes to be displayed on adisplay screen in the content sharing state. Here, FIG. 3 illustrates anexample of a display image when the control apparatus 100 and twocommunication target apparatuses establish communication, which relatesto a telephone call (for example, a video telephone call) based on acaptured image and audio, with one another.

As illustrated in FIG. 3, for example, the control apparatus 100 causesthe display image to be displayed on the display screen, the displayimage being an image in which an image (D in FIG. 3) indicated by thecontent data and captured images (E and F in FIG. 3) transmitted fromthe communication target apparatuses and received by the controlapparatus 100 are arranged in a virtual space. As illustrated in FIG. 3,the display image in which the image (D in FIG. 3) indicated by thecontent data and the captured images (E and F in FIG. 3) are arranged inthe virtual space is displayed on the display screen, and thereby theuser can visually recognize the content sharing state. In addition, itshould be understood that the display image that the control apparatus100 causes to be displayed on the display screen in the content sharingstate is not limited to the example illustrated in FIG. 3.

In addition, on the basis of the individual positions of the image (D inFIG. 3) indicated by the content data and the captured images (E and Fin FIG. 3), in the virtual space, the control apparatus 100 individuallylocalizes the sound images of the content audio signal and the externalspeech audio signal, output from the audio input device included in theself apparatus or the external audio input device. Here, for example,the control apparatus 100 preliminarily specifies the display positionof the image indicated by the content data in the virtual space, andadds, for example, a sound effect such as reverberant sound or the liketo audio indicated by the content audio signal, using an audiolocalization parameter preliminarily set for the preliminarily specifieddisplay position. In addition, in the same way as the above-mentionedcontent audio signal, the control apparatus 100 also adds a sound effectsuch as reverberant sound or the like to speech audio indicated by theexternal speech audio signal, using an audio localization parameterpreliminarily set for each of preliminarily specified display positions,for example.

As described above, by individually localizing the sound images of thecontent audio signal and the external speech audio signal, output fromthe audio input device included in the self apparatus or the externalaudio input device, the control apparatus 100 can provide, to the user,a higher sense of a content shared between the user and the user of thecommunication target apparatus. In addition, a sound image localizationmethod performed in the control apparatus 100 according to an embodimentof the present technology is not limited to the above-mentioned example,and an arbitrary method for individually localizing the sound images ofthe content audio signal and the external speech audio signal may beused as the sound image localization method.

In addition, for example, when the communication target apparatus has aconfiguration in which processing according to the content sharingapproach according to an embodiment of the present technology isperformed (namely, the communication target apparatus is another controlapparatus 100), the communication target apparatus causes, for example,such a display image as illustrated in FIG. 3 to be displayed on adisplay screen and localizes a sound image, in the same way as thecontrol apparatus 100, for example. Accordingly, in the above-mentionedcase, since both the user of the control apparatus 100 and the user ofthe communication target apparatus feel as if the users enjoyed acontent at a same location, the improvement of convenience for the usersin a whole communication system in which communication relating to atelephone call is performed is achieved.

As described above, when no content data is reproduced, the controlapparatus 100 performs the processing illustrated in the above-mentioned(1), for example. In addition, when content data is reproduced orcontent data is to be reproduced from now, the control apparatus 100selectively performs, for example, the processing (content non-sharingprocessing) illustrated in the above-mentioned (2) or the processing(content sharing processing) illustrated in the above-mentioned (3), onthe basis of the determination result as to whether or not a contentindicated by the content data is to be shared with the communicationtarget apparatus.

Here, when it is determined that the content indicated by the contentdata is to be shared with the communication target apparatus (namely, ina case of the content sharing state), the control apparatus 100 causes aspeech audio signal and a content audio signal, which relate to atelephone call, to be transmitted to the communication target apparatus.Accordingly, since it is possible to provide, to the users, a sense thatthey enjoy the content at a same location even if the control apparatus100 and the communication target apparatus are located at remotelocations, the control apparatus 100 can achieve the improvement ofconvenience for users.

In addition, when it is not determined that the content indicated by thecontent data is to be shared with the communication target apparatus(namely, in a case of the content non-sharing state), the controlapparatus 100 causes the speech audio signal to be transmitted to thecommunication target apparatus and does not cause the content audiosignal to be transmitted to the communication target apparatus.Accordingly, since the control apparatus 100 can prevent the user of thecommunication target apparatus from hearing audio indicated by thecontent data reproduced in the control apparatus 100, the controlapparatus 100 can prevent the privacy of the user from being invaded.

Accordingly, when the control apparatus 100 establishes communicationrelating to a telephone call with the communication target apparatus,the control apparatus 100 can cause a content indicated by the contentdata to be selectively shared with the communication target apparatus,with preventing the invasion of privacy of the user.

[Specific Example of Processing According to Content Sharing Approach]

Next, an example of processing for realizing the above-mentioned contentsharing approach according to an embodiment of the present technologywill be described. FIG. 4 is a flowchart illustrating an example ofprocessing according to the content sharing approach performed in thecontrol apparatus 100 according to an embodiment of the presenttechnology.

The control apparatus 100 determines whether or not communication withthe communication target apparatus, which relates to a telephone call,has been started (S100). When, in Step S100, it is not determined thatthe communication with the communication target apparatus, which relatesto a telephone call, has been started, the control apparatus 100 doesnot proceed with the processing until it is determined that thecommunication relating to a telephone call has been started.

In addition, when, in Step S100, it is determined that the communicationwith the communication target apparatus, which relates to a telephonecall, has been started, the control apparatus 100 determines whether ornot content sharing is to be performed between the control apparatus 100and the communication target apparatus (S102).

Here, for example, on the basis of the state of a hardware switch usedfor specifying the on/off state of the content sharing or the state of asoftware switch used for specifying the on/off state of the contentsharing on the basis of an external operation signal transmitted from anexternal operation apparatus such as a remote controller or the like,the control apparatus 100 performs the determination in Step S102. Inaddition, the processing in Step S102, performed in the controlapparatus 100 according to an embodiment of the present technology, isnot limited to the above-mentioned example.

For example, the control apparatus 100 may detect a predeterminedmovement of the user on the basis of a captured image, and determinewhether or not the content sharing is to be performed between thecontrol apparatus 100 and the communication target apparatus on thebasis of the detection result. In the above-mentioned case, for example,by performing image processing on a captured image generated by theimaging device included in the self apparatus or the external imagingdevice, the control apparatus 100 detects the predetermined movement ofthe user included in the captured image (for example, the shape or theperiodic movement of a hand or the like, which indicates the on/offstate of the content sharing). In addition, for example, when an ONoperation for the content sharing is detected, the control apparatus 100determines that the content sharing is to be performed between thecontrol apparatus 100 and the communication target apparatus. Here, forexample, when an ON operation for the content sharing is detected, thecontrol apparatus 100 determines that the content sharing is to beperformed until an OFF operation for the content sharing is detected.However, the processing performed in the control apparatus 100 is notlimited to the above-mentioned example. For example, when the controlapparatus 100 gives notice of an error in Step S114 described later, thecontrol apparatus 100 may not determine that the content sharing is tobe performed, until the ON operation for the content sharing is detectedagain.

[1] Case in which it is not Determined that Content Sharing is to bePerformed

When, in Step S102, it is not determined that the content sharing is tobe performed between the control apparatus 100 and the communicationtarget apparatus, the control apparatus 100 determines whether or notthe content data is reproduced (S104).

When, in Step S104, it is not determined that the content data isreproduced, the control apparatus 100 performs processing in Step S108described later. Here, when, in Step S104, it is not determined that thecontent data is reproduced, the control apparatus 100 performsprocessing according to communication relating to a telephone call,between the control apparatus 100 and the communication targetapparatus. Namely, the processing performed in the control apparatus 100when, in Step S104, it is not determined that the content data isreproduced corresponds to the processing illustrated in theabove-mentioned (1).

In addition, when, in Step S104, it is determined that the content datais reproduced, the control apparatus 100 performs the contentnon-sharing processing (S106). Here, in Step S106, the control apparatus100 performs processing illustrated in the above-mentioned (2). Namely,the processing in Step S106 is performed, and thereby it is possible toprevent the user of the communication target apparatus for hearing audioindicated by the content data reproduced in the control apparatus 100,for example. Therefore, the control apparatus 100 can prevent theprivacy of the user from being invaded.

When, in Step S104, it is not determined that the content data isreproduced or when the processing in Step S106 is performed, the controlapparatus 100 determines whether or not the processing according to thecommunication with the communication target apparatus, which relates toa telephone call, is to be terminated (S108). Here, for example, when anexternal operation signal transmitted from the external operationapparatus such as a remote controller or the like or an operation signalcorresponding to a user operation, transmitted from an operation unit(described later) included in the self apparatus indicates thetermination of the communication relating to a telephone call, thecontrol apparatus 100 determines the communication relating to atelephone call is to be terminated. In addition, the processing in StepS108 is not limited to the above-mentioned example. For example, when,by performing image processing on a captured image, a predeterminedmovement of the user included in the captured image (for example, theshape or the periodic movement of a hand or the like, which indicatesthe termination of the communication relating to a telephone call) isdetected, the control apparatus 100 may also determine that thecommunication relating to a telephone call is to be terminated.

When, in Step S108, it is not determined that the communication with thecommunication target apparatus, which relates to a telephone call, is tobe terminated, the control apparatus 100 repeats the processing fromStep S102.

In addition, when, in Step S108, it is determined that the communicationwith the communication target apparatus, which relates to a telephonecall, is to be terminated, the control apparatus 100 terminates thecommunication with the communication target apparatus, which relates toa telephone call, by performing the truncation of a session or the like,for example (S110), and terminates the processing according to thecontent sharing approach. In addition, the processing according to thecontent sharing approach illustrated in FIG. 4 is not a kind ofprocessing that is once terminated and not performed again, and thecontrol apparatus 100 may repeat the processing according to the contentsharing approach illustrated in FIG. 4 even if the processing is onceterminated.

[2] Case in which it is Determined that Content Sharing is to bePerformed

When, in Step S102, it is determined that the content sharing is to beperformed between the control apparatus 100 and the communication targetapparatus, the control apparatus 100 determines whether or not it ispossible to perform content sharing between the control apparatus 100and the communication target apparatus (S112). Here, for example, whenthe control apparatus 100 communicates with the communication targetapparatus and it is determined that the content sharing is also to beperformed in the communication target apparatus, the control apparatus100 determines that it is possible to perform content sharing betweenthe control apparatus 100 and the communication target apparatus.However, the processing in Step S112 is not limited to theabove-mentioned example.

For example, when the control apparatus 100 communicates with a contentmanagement server performing license management for content data or thelike, and content data corresponding to a content that a user desires toshare is authenticated by the content management server (the sharing ofthe content data is allowed), the control apparatus 100 may determinethat it is possible to perform content sharing between the controlapparatus 100 and the communication target apparatus. Namely, thecontent management server according to an embodiment of the presenttechnology fulfills a role for managing the sharing of the content databetween the control apparatus 100 and the communication targetapparatus.

As described above, when the sharing of a content is authenticated bythe content management server, the sharing of the content is performedbetween the control apparatus 100 and the communication targetapparatus. Therefore, even if both the user and the user of thecommunication target apparatus desire to share a content, no content isshared between the control apparatus 100 and the communication targetapparatus. Accordingly, as described above, when the sharing of acontent is authenticated by the content management server, the sharingof the content is performed between the control apparatus 100 and thecommunication target apparatus. Consequently, the license management forcontent data that is to be the target of sharing is realized.

When, in Step S112, it is not determined that it is possible to performcontent sharing between the control apparatus 100 and the communicationtarget apparatus, the control apparatus 100 notifies the user of anerror (S114). In addition, the control apparatus 100 performs theprocessing from Step S104. Here, while, for example, by causing an errordisplay screen to be displayed on the display screen, the controlapparatus 100 visually notifies the user of an error, the processing inStep S114 is not limited to the above-mentioned example. For example, bycausing the audio output device or the audio output apparatus to outputaudio indicating an error, the control apparatus 100 can also aurallynotify the user of an error.

In addition, when, in Step S112, it is determined that it is possible toperform content sharing between the control apparatus 100 and thecommunication target apparatus, the control apparatus 100 performs thecontent sharing processing (S116). Here, in Step S116, the controlapparatus 100 performs the processing illustrated in the above-mentioned(3). Namely, by performing the processing in Step S116, it is possibleto provide, to the users, a sense that the users enjoy a content at asame location, even if the control apparatus 100 and the communicationtarget apparatus are located at remote locations. Therefore, the controlapparatus 100 can achieve the improvement of convenience for the users.

When the processing in Step S116 is performed, the control apparatus 100determines whether or not the content sharing is to be terminated(S118). Here, for example, in the same way as in Step S102, on the basisof the state of the hardware switch or the software switch, apredetermined movement of the user detected from the captured image, orthe like, the control apparatus 100 performs the determination in StepS118.

When, in Step S118, it is not determined that the content sharing is tobe terminated, the control apparatus 100 repeats the processing fromStep S116. In addition, when, in Step S118, it is determined that thecontent sharing is to be terminated, the control apparatus 100 repeatsthe processing from Step S104.

For example, by performing the processing illustrated in FIG. 4, thecontrol apparatus 100 selectively performs the processing illustrated inthe above-mentioned (1) to the processing illustrated in theabove-mentioned (3), and realizes the processing according to thecontent sharing approach according to an embodiment of the presenttechnology. Accordingly, for example, by performing the processingillustrated in FIG. 4, the control apparatus 100 can cause a contentindicated by content data to be selectively shared with thecommunication target apparatus with preventing the invasion of theprivacy of a user when the communication with the communication targetapparatus, which relates to a telephone call, is established. Inaddition, it should be understood that the processing according to thecontent sharing approach performed in the control apparatus 100according to an embodiment of the present technology is not limited tothe processing illustrated in FIG. 4.

(Control Apparatus According to Embodiment of Present Technology)

Next, an example of the configuration of the control apparatus 100according to an embodiment of the present technology will be describedthat can perform the processing according to the content sharingapproach according to an embodiment of the present technology, describedabove.

First Embodiment

FIG. 5 is a block diagram illustrating an example of the configurationof the control apparatus 100 according to a first embodiment of thepresent technology.

Here, in FIG. 5, a display system 200 used for performing the display ofan image (still image or moving image) on the display screen, thegeneration of a captured image base on the imaging of a displaydirection of the display screen, and audio input•audio output forrealizing a telephone call based on audio, a communication targetapparatus 300, and a content management server 400, connected through anetwork 500, are illustrated in combination. Here, the above-mentionedterm “connected through a network 500” means that one apparatus andanother apparatus communicate with each other through the network 500,or the apparatuses are in states in which the apparatuses cancommunicate with each other. In addition, for example, as the network500, a wired network such as a local area network (LAN), a wide areanetwork (WAN), or the like, a wireless network such as a wireless widearea network (wireless WAN; WWAN) through a base station, or the like,or Internet utilizing a communication protocol such as TransmissionControl Protocol/Internet Protocol (TCP/IP) or the like may be cited. Inaddition, the control apparatus 100, the communication target apparatus300, and the content management server 400 not only establishcommunication through the network 500 but may directly establishcommunication, for example. In addition, each of the communicationtarget apparatus 300 may be an apparatus having the same function asthat of the control apparatus 100 (namely, another control apparatus100). Hereinafter, in some case, one or more communication targetapparatuses that establish communication relating to a telephone callwith the control apparatus 100 are collectively indicated as“communication target apparatus 300”.

For example, according to the configuration illustrated in FIG. 5, auser who uses the control apparatus 100 and the display system 200 canhave a telephone call based on a captured image and audio such as, forexample, a video telephone call, with a user of the communication targetapparatus 300. In addition, for example, the display system 200 in FIG.5 may be replaced with an audio input-output system (not illustrated)used for performing audio input audio output for realizing a telephonecall based on audio, the audio input-output system including amicrophone, a speaker, and the like. In the above-mentioned case, a userwho uses the control apparatus 100 and the audio input-output system(not illustrated) has a telephone call based on audio with the user ofthe communication target apparatus 300.

In addition, while FIG. 5 illustrates an example in which the displaysystem 200 includes a display apparatus 600 for performing display, animaging apparatus 700 for imaging, an audio output apparatus 800 foroutputting audio, and an audio input apparatus 900 for inputting audio,the configuration of the display system 200 according to an embodimentof the present technology is not limited to the above-mentioned example.For example, the display system 200 may be an apparatus in which thedisplay apparatus 600, the imaging apparatus 700, and the audio outputapparatus 800 are united together (for example, a display apparatushaving an imaging function and an audio output function). In addition,for example, the display system 200 may be one apparatus having adisplay function, an imaging function, an audio output function, and anaudio input function.

Here, the display system 200 generates a captured image obtained byimaging a display direction of the display screen, and thereby acaptured image in which a user watching the display screen is imaged isobtained. Accordingly, by processing the captured image generated by thedisplay system 200, the control apparatus 100 can easily perform imageprocessing or the like when the predetermined movement of the user isdetected on the basis of a captured image, in the processing operationsin Steps S102, S108, and S118, for example.

With reference to FIG. 5, the control apparatus 100 includes a storageunit 102, a communication unit 104, an input unit 106, and a controlunit 108.

In addition, for example, the control apparatus 100 may include anon-transitory computer readable medium such as read only memory (ROM;not illustrated), a random access memory (RAM; not illustrated), auser-operable operation unit (not illustrated), and the like. Forexample, the control apparatus 100 connects individual configurationelements to one another, using a bus as the transmission path of data.

Here, for example, the ROM (not illustrated) stores a program used bythe control unit 108 and control data such as an operation parameter andthe like. For example, the RAM (not illustrated) temporarily stores aprogram executed by the control unit 108, and the like. In addition, asthe operation unit (not illustrated), a button, a direction key, acombination thereof, or the like may be cited. In addition, the controlapparatus 100 may be connected to an operation input device (forexample, a keyboard, a mouse, or the like) functioning as the externalapparatus of the control apparatus 100.

[Example of Hardware Configuration of Control Apparatus 100]

FIG. 6 is an explanatory diagram illustrating an example of the hardwareconfiguration of the control apparatus 100 according to an embodiment ofthe present technology. With reference to FIG. 6, for example, thecontrol apparatus 100 includes an MPU 150, a ROM 152, a RAM 154, arecording medium 156, an input-output interface 158, an operation inputdevice 160, a display device 162, and a communication interface 164. Inaddition, for example, the control apparatus 100 connects individualconfiguration elements to one another, using a bus 166 as thetransmission path of data.

The MPU 150 includes an integrated circuit or the like into which aplurality of circuits for realizing various kinds of functions areintegrated, such as a micro processing unit (MPU), a circuit forrealizing image processing such as an encoder, a decoder, or the like, acircuit for realizing audio processing such as an adaptive filter, anadder, or the like, and the like, and the MPU 150 functions as a controlunit (not illustrated) for controlling the whole control apparatus 100.In addition, in the control apparatus 100, the MPU 150 functions as areproduction processing unit 110, a determination unit 112, and asharing processing unit 114.

The ROM 152 stores a program used by the MPU 150, control data such asan operation parameter and the like, and the like. For example, the RAM154 temporarily stores a program executed by the MPU 150, and the like.

The recording medium 156 functions as the storage unit 102, and storescontent data, audio localization data into which an audio localizationparameter is recorded, an application, and the like, for example. Here,for example, a magnetic recording medium such as a hard disk or the likeor a nonvolatile memory such as an electrically erasable andprogrammable read only memory (EEPROM), a flash memory, amagnetoresistive random access memory (MRAM), a ferroelectric randomaccess memory (FeRAM), a phase change random access memory (PRAM), orthe like may be cited as the recording medium 156. In addition, thecontrol apparatus 100 may include the recording medium 156 that can beattached and removed to and from the control apparatus 100.

For example, the input-output interface 158 connects the operation inputdevice 160 and the display device 162. In addition, the input-outputinterface 158 may also function as the input unit 106. The operationinput device 160 functions as an operation unit (not illustrated), and,in addition, the display device 162 functions as a display unit(described later). Here, for example, an audio input terminal and anaudio output terminal, a universal serial bus (USB) terminal, a digitalvisual interface (DVI) terminal, a high-definition multimedia interface(HDMI) terminal, various kinds of processing circuits, or the like maybe cited as the input-output interface 158. In addition, for example,the operation input device 160 is provided on the control apparatus 100,and is connected to the input-output interface 158 within the controlapparatus 100. For example, a button, a direction key, a rotationalselector such as a jog dial, a combination thereof, or the like may becited as the operation input device 160. In addition, for example, thedisplay device 162 is provided on the control apparatus 100, and isconnected to the input-output interface 158 within the control apparatus100. For example, a liquid crystal display (LCD), an organic ElectroLuminescence display (organic EL display; or also referred to as organiclight emitting diode display (OLED display)), or the like may be citedas the display device 162. In addition, it should be understood that theinput-output interface 158 can be connected to external devices such asan operation input device (for example, a keyboard, a mouse, or thelike) functioning as the external apparatus of the control apparatus100, a display device (for example, an external display device such asthe display apparatus 600 or the like), an imaging device (for example,the imaging apparatus 700 or the like), and the like. In addition, forexample, the display device 162 may be a user-operable device such as atouch screen or the like, which can perform display.

The communication interface 164 is a communication mechanism included inthe control apparatus 100, and functions as the communication unit 104used for establishing wireless/wired communication, through the network500 (or, directly), with external apparatuses such as the display system200, the communication target apparatus 300, the content managementserver 400, a server for storing content data (not illustrated), and thelike, for example. Here, for example, a communication antenna and an RFcircuit (wireless communication), an IEEE 802.15.1 port and atransmitting and receiving circuit (wireless communication), an IEEE802.11b port and a transmitting and receiving circuit (wirelesscommunication), an LAN terminal and a transmitting and receiving circuit(wired communication), or the like may be cited as the communicationinterface 164.

For example, according to the configuration illustrated in FIG. 6, thecontrol apparatus 100 performs processing according to the contentsharing approach according to an embodiment of the present technology.In addition, the hardware configuration of the control apparatus 100according to an embodiment of the present technology is not limited tothe configuration illustrated in FIG. 6.

For example, the control apparatus 100 may include an imaging devicethat functions as an imaging unit (described later) and includes alens/imaging element and a signal processing circuit, for example. Inthe above-mentioned case, the control apparatus 100 may performprocessing on a captured image generated by the self apparatus, andestablish communication, which relates to a telephone call (for example,video telephone call) based on a captured image and audio, with thecommunication target apparatus 300. Here, for example, the lens/imagingelement includes a lens of an optical system and an image sensor inwhich a plurality of imaging elements such as charge coupled devices(CCD), complementary metal oxide semiconductors (CMOS), or the like areused. For example, the signal processing circuit includes an automaticgain control (AGC) circuit and an analog to digital converter (ADC),converts an analog signal generated by the imaging elements into adigital signal (image data), and performs various kinds of signalprocessing. Examples of signal processing performed by the signalprocessing circuit may include White Balance correction processing,interpolation processing, color tone correction processing, gammacorrection processing, YCbCr conversion processing, edge enhancementprocessing, coating processing, and the like.

In addition, for example, the control apparatus 100 may include amicrophone and an amplifier, which may function as an audio input unit(described later). In the above-mentioned case, for example, the controlapparatus 100 can establish communication relating to a telephone callwith the communication target apparatus 300, using a generated audiosignal generated in the self apparatus.

In addition, for example, the control apparatus 100 may include an audiooutput device that functions as an audio output unit (described later)and includes a digital signal processor (DSP), an amplifier, a speaker,and the like. In the above-mentioned case, for example, the controlapparatus 100 can output various kinds of audio such as audio indicatedreproduced content data, speech audio relating to a telephone call hadwith the communication target apparatus 300, and the like.

Furthermore, for example, the control apparatus 100 may have aconfiguration that does not include the operation device 160 and thedisplay device 162, illustrated in FIG. 6.

The configuration of the control apparatus 100 according to the firstembodiment of the present technology will be described with reference toFIG. 5 again. The storage unit 102 is a storing mechanism included inthe control apparatus 100. Here, for example, a magnetic recordingmedium such as a hard disk or the like, a nonvolatile memory such as aflash memory or the like, or the like may be cited as the storage unit102.

In addition, for example, the storage unit 102 stores content data,audio localization data, an application, and the like. FIG. 5illustrates an example in which the content data 140 are stored in thestorage unit 102.

The communication unit 104 is a communication mechanism included in thecontrol apparatus 100, and establishes wireless/wired communication,through the network 500 (or, directly), with external apparatuses suchas the display system 200, the communication target apparatus 300, thecontent management server 400, and the like. The control apparatus 100includes the communication unit 104, and thereby can establishcommunication with one or more communication target apparatuses 300 andestablish communication relating to a telephone call (communicationrelating to a telephone call based on audio or a telephone call based ona captured image and audio). In addition, for example, with respect tothe communication unit 104, communication is controlled by the controlunit 108.

Here, while, for example, a communication antenna and an RF circuit, aLAN terminal and a transmitting and receiving circuit, or the like maybe cited as the communication unit 104, the communication unit 104 isnot limited to the above-mentioned examples. For example, thecommunication unit 104 may have an arbitrary configuration in which thecommunication unit 104 can communicate with an external apparatusthrough the network 500.

For example, the input unit 106 receives a captured image that theimaging apparatus 700 generates by imaging, and an audio signal(generated audio signal) that the audio input apparatus 900 generates.In addition, the input unit 106 transmits a received (input) capturedimage and a received (input) audio signal to the control unit 108. Here,while, for example, an audio input terminal, an audio output terminal, aUSB terminal, a DVI terminal, an HDMI terminal, various kinds ofprocessing circuits, or the like may be cited as the input unit 106, theinput unit 106 is not limited to the above-mentioned examples. Forexample, the input unit 106 may have an arbitrary configuration that canreceive a captured image and an audio signal by a wired or wirelessconnection from an external apparatus.

For example, the control unit 108 includes an MPU, a circuit forrealizing image processing such as an encoder, a decoder, or the like, acircuit for realizing audio processing, such as an adaptive filter, anadder, or the like, and fulfills a role for controlling the wholecontrol apparatus 100. In addition, the control unit 108 includes areproduction processing unit 110, a determination unit 112, and asharing processing unit 114, and fulfills an initiative role forperforming processing according to the content sharing approachaccording to an embodiment of the present technology. In addition, thecontrol unit 108 may include a communication control unit (notillustrated) for controlling communication with an external apparatussuch as the communication target apparatus 300 or the like.

For example, the reproduction processing unit 110 reproduces contentdata stored in the storage unit 102 or content data that is transmittedfrom an external apparatus such as the communication target apparatus300 or a server (not illustrated) and received by the communication unit104.

The determination unit 112 fulfills a role for determining areproduction state in the control apparatus 100 and transmitting thedetermination result to the sharing processing unit 114.

More specifically, for example, in a case in which content data is notreproduced in the reproduction processing unit 110 when communicationrelating to a telephone call is established with the communicationtarget apparatus 300, the determination unit 112 transmits to thesharing processing unit 114 the determination result indicating that theprocessing (content non-sharing processing) in the above-mentioned (2)and the processing (content sharing processing) in the above-mentioned(3) are not to be performed.

In addition, for example, in a case in which communication relating to atelephone call is established with the communication target apparatus300, when content data is reproduced in the reproduction processing unit110 or when content data is to be reproduced from now, the determinationunit 112 determines whether or not audio indicated by the content datais to be shared with the communication target apparatus 300. Here, whenthe determination unit 112 determines whether or not the audio indicatedby the content data is to be shared with the communication targetapparatus 300, the determination unit 112 communicates with the contentmanagement server 400 through the communication unit 104, for example.In addition, when the content management server 400 allows the contentdata to be shared, the determination unit 112 determines that the audioindicated by the content data is to be shared.

In addition, on the basis of determination result as to whether or not acontent indicated by the content data is to be shared with thecommunication target apparatus 300, the determination unit 112 transmitsto the sharing processing unit 114 the determination result used forcausing the processing (content non-sharing processing) illustrated inthe above-mentioned (2) or the processing (content sharing processing)illustrated in the above-mentioned (3) to be selectively performed.

Here, for example, a processing operation in Step S100, S102, S104,S108, S112, or S118 may be cited as processing performed in thedetermination unit 112 in the processing according to the contentsharing approach illustrated in FIG. 4. In addition, the processingperformed in the determination unit 112 in the processing according tothe content sharing approach illustrated in FIG. 4 is not limited to theabove-mentioned examples. For example, in the control apparatus 100according to an embodiment of the present technology, a communicationcontrol unit (not illustrated) may perform a processing operation inStep S100 or S108 in the processing according to the content sharingapproach illustrated in FIG. 4, for example.

On the basis of the determination result transmitted from thedetermination unit 112, the sharing processing unit 114 selectivelyperforms the processing (content non-sharing processing) illustrated inthe above-mentioned (2) or the processing (content sharing processing)illustrated in the above-mentioned (3). More specifically, when, in thedetermination unit 112, it is not determined that the audio indicated bythe content data is to be shared with the communication target apparatus300, the sharing processing unit 114 performs the processing (contentnon-sharing processing) illustrated in the above-mentioned (2). Inaddition, when, in the determination unit 112, it is determined that theaudio indicated by the content data is to be shared with thecommunication target apparatus 300, the sharing processing unit 114selectively performs the processing (content sharing processing)illustrated in the above-mentioned (3).

Here, for example, a processing operation in Step S106, S114, or S116may be cited as processing performed in the sharing processing unit 114in the processing according to the content sharing approach illustratedin FIG. 4.

For example, the control unit 108 includes the reproduction processingunit 110, the determination unit 112, and the sharing processing unit114, and thereby can fulfill an initiative role for performingprocessing according to the content sharing approach. In addition, itshould be understood that the configuration of the control unit 108 isnot limited to the configuration illustrated in FIG. 5.

For example, according to the configuration illustrated in FIG. 5, thecontrol apparatus 100 according to the first embodiment can realize theprocessing according to the content sharing approach according to anembodiment of the present technology. Accordingly, for example,according to the configuration illustrated in FIG. 5, when communicationwith the communication target apparatus 300, which relates to atelephone call, is established, the control apparatus 100 can cause acontent indicated by the content data to be selectively shared with thecommunication target apparatus 300 with preventing the invasion of theprivacy of the user. In addition, it should be understood that theconfiguration of the control apparatus 100 according to the firstembodiment of the present technology is not limited to the configurationillustrated in FIG. 5.

Second Embodiment

FIG. 7 is a block diagram illustrating an example of the configurationof a control apparatus 100 according to a second embodiment of thepresent technology. Here, in the same way as in FIG. 5, in FIG. 7, acommunication target apparatus 300, and a content management server 400,connected through a network 500, are illustrated in combination.

While the control apparatus 100 according to the second embodiment,illustrated in FIG. 7, has basically the same as that of the controlapparatus 100 according to the first embodiment, illustrated in FIG. 5,the control apparatus 100 according to the second embodiment does notinclude the input unit 106, and further includes an audio input unit120, an imaging unit 122, a display unit 124, and an audio output unit126, compared with the control apparatus 100 according to the firstembodiment, illustrated in FIG. 5.

The audio input unit 120 is an audio signal generation mechanismincluded in the control apparatus 100. For example, a microphone may becited as the audio input unit 120. In addition, the audio input unit 120may be attached and removed to and from the control apparatus 100.

The imaging unit 122 is an imaging mechanism included in the controlapparatus 100, and images the display direction of a display screendisplayed by the display unit 124, thereby generating a captured image.In addition, when the control apparatus 100 according to the secondembodiment has no function for performing communication relating to atelephone call based on a captured image and audio, the controlapparatus 100 may has a configuration in which the imaging unit 122 isnot included. Here, for example, an imaging device including alens/imaging element and a signal processing circuit may be cited as theimaging unit 122.

The display unit 124 is a displaying mechanism included in the controlapparatus 100, and displays various kinds of information or images onthe display screen. For example, a content display screen for displayingan image indicated by content data, a screen on which a captured imagerelating to a telephone call is displayed, an operation screen forcausing the control apparatus 100 to perform a desired operation, or thelike may be cited as a screen displayed on the display screen of thedisplay unit 124. In addition, on the screen on which the captured imagerelating to a telephone call is displayed, the captured image may bedisplayed in parallel with an image indicated by a content, or displayedwith being superimposed on the image indicated by the content. Inaddition, for example, a liquid crystal display or an organic EL displaymay be cited as the display unit 124.

The audio output unit 126 is an audio output mechanism included in thecontrol apparatus 100, and outputs various kinds of audio such as audioindicated by reproduced content data, speech audio relating to atelephone call, system audio in the control apparatus 100, and the like,for example. Here, for example, a DSP and an audio output deviceincluding an amplifier and a speaker may be cited as the audio outputunit 126.

The control apparatus 100 according to the second embodiment hasbasically the same configuration as that of the control apparatus 100according to the first embodiment, illustrated in FIG. 5. Accordingly,on the basis of the configuration illustrated in FIG. 7, the controlapparatus 100 according to the second embodiment can realize theprocessing according to the content sharing approach according to anembodiment of the present technology, in the same way as the controlapparatus 100 according to the first embodiment. Accordingly, forexample, according to the configuration illustrated in FIG. 7, when thecontrol apparatus 100 establishes communication relating to a telephonecall with the communication target apparatus 300, the control apparatus100 can cause a content indicated by the content data to be selectivelyshared with the communication target apparatus 300, with preventing theinvasion of privacy of the user. In addition, the configuration of thecontrol apparatus 100 according to the second embodiment of the presenttechnology is not limited to the configuration illustrated in FIG. 7.For example, the control apparatus 100 according to the secondembodiment may include the input unit 106 in the same way as the controlapparatus 100 according to the first embodiment, illustrated in FIG. 5.

As described above, the control apparatus 100 according to an embodimentof the present technology selectively performs the processing (contentnon-sharing processing) illustrated in the above-mentioned (2) or theprocessing (content sharing processing) illustrated in theabove-mentioned (3), on the basis of the determination result as towhether or not the audio indicated by the content data is to be sharedwith the communication target apparatus 300. Here, when it is determinedthat the content indicated by the content data is to be shared with thecommunication target apparatus 300 (namely, in a case of the contentsharing state), the control apparatus 100 causes a speech audio signaland a content audio signal, which relate to a telephone call, to betransmitted to the communication target apparatus 300. Accordingly,since it is possible to provide, to the users, a sense that they enjoythe content at a same location even if the control apparatus and thecommunication target apparatus 300 are located at remote locations, thecontrol apparatus 100 can achieve the improvement of convenience forusers. In addition, when it is not determined that the content indicatedby the content data is to be shared with the communication targetapparatus 300 (namely, in a case of the content non-sharing state), thecontrol apparatus 100 causes the speech audio signal to be transmittedto the communication target apparatus and does not cause the contentaudio signal to be transmitted to the communication target apparatus300. Accordingly, since the control apparatus 100 can prevent the userof the communication target apparatus 300 from hearing audio indicatedby the content data reproduced in the control apparatus 100, the controlapparatus 100 can prevent the privacy of the user from being invaded.

Accordingly, when the control apparatus 100 establishes communicationrelating to a telephone call with the communication target apparatus300, the control apparatus 100 can cause a content indicated by thecontent data to be selectively shared with the communication targetapparatus 300, with preventing the invasion of privacy of the user.

While the control apparatus 100 has been cited as an embodiment of thepresent technology and described so far, an embodiment of the presenttechnology is not limited to such an embodiment. For example, anembodiment of the present technology may be applied to various types ofdevices, such as a computer such as a PC, a server, or the like, adisplay apparatus such as a television receiver, a signage apparatus, orthe like, a portable communication apparatus such as a mobile phone orthe like, a video/music reproducing apparatus (or video/music recordingand reproducing apparatus), a game machine, a set-top box, and the like.

In addition, while the display system 200 has been cited as anembodiment of the present technology and described, an embodiment of thepresent technology is not limited to such an embodiment. For example, anembodiment of the present technology may be applied to various types ofdevices, such as a computer such as a PC or the like, a displayapparatus such as a television receiver, a signage apparatus, or thelike, a portable communication apparatus such as a mobile phone or thelike, and the like. In addition, the display system 200 according to anembodiment of the present technology may be the combination of a devicefor performing display, a device for imaging, a device for generating anaudio signal, and a device for outputting an audio signal.

In addition, while the communication target apparatus 300 has been citedas an embodiment of the present technology and described, an embodimentof the present technology is not limited to such an embodiment. Forexample, an embodiment of the present technology may be applied tovarious types of devices, such as a computer such as a PC, a server, orthe like, a display apparatus such as a television receiver, a signageapparatus, or the like, a portable communication apparatus such as amobile phone or the like, a video/music reproducing apparatus (orvideo/music recording and reproducing apparatus), a game machine, aset-top box, and the like.

In addition, while the content management server 400 has been cited asan embodiment of the present technology and described, an embodiment ofthe present technology is not limited to such an embodiment. Forexample, an embodiment of the present technology may be applied tovarious types of devices such as a computer such as a PC, a server, orthe like, and the like.

(Program According to Embodiment of Present Technology)

On the basis of a program used for causing a computer to function as acontrol apparatus according to an embodiment of the present technology(for example, a program used for realizing the processing according tothe content sharing approach according to an embodiment of the presenttechnology, illustrated in FIG. 4), it is possible to cause a contentindicated by the content data to be selectively shared with thecommunication target apparatus, with preventing the invasion of privacyof the user, when communication relating to a telephone call isestablished with the communication target apparatus.

While preferred embodiments of the present technology have beendescribed with reference to figures so far, it should be understood thatthe present technology is not limited to such examples. It should beunderstood by those skilled in the art that various modifications andalterations may occur insofar as they are within the scope of theappended claims, and it should be understood that those also belong tothe technical scope of the present technology.

For example, the control apparatus 100 according to an embodiment of thepresent technology may individually include the reproduction processingunit 110, the determination unit 112, and the sharing processing unit114, illustrated in FIGS. 5 and 7, (for example, individually realizesthe reproduction processing unit 110, the determination unit 112, andthe sharing processing unit 114, using individual processing circuits).

In addition, while, in the above-description, a case in which a program(computer program) used for causing the computer to function as thecontrol apparatus according to an embodiment of the present technologyis provided has been illustrated, furthermore, an embodiment of thepresent technology may also provide the program and a recording mediumin which the program is stored, in combination.

The above-mentioned configuration indicates an example of an embodimentof the present technology, and it should be understood that theconfiguration also belongs to the technical scope of the presenttechnology.

It should be understood by those skilled in the art that variousmodifications, combinations, sub-combinations and alterations may occurdepending on design requirements and other factors insofar as they arewithin the scope of the appended claims or the equivalents thereof.

What is claimed is:
 1. A control apparatus for selective contentsharing, the control apparatus comprising: a processor; an input unitfor receiving a captured image; a memory storing content data andinstructions, the instructions, when executed by the processor, causethe processor to: establish communication with a communication targetapparatus; reproduce content indicated by the content data, thereproduced content representing an image; determine whether or not toshare the reproduced content indicated by the content data with thecommunication target apparatus; selectively perform, in accordance witha result of the determination, a process to share or not share thereproduced content indicated by the content data with the communicationtarget apparatus, such that, when the reproduced content indicated bythe content data is determined not to be shared with the communicationtarget apparatus, (i) share a generated speech audio signal with thecommunication target apparatus and (ii) to not share the reproducedcontent indicated by the content data with the communication targetapparatus, and, when the reproduced content indicated by the contentdata is determined to be shared with the communication target apparatus,share the generated speech audio signal with the communication targetapparatus and to share the reproduced content indicated by the contentdata with the communication target apparatus; and cause the capturedimage and the image represented by the reproduced content to bedisplayed on a display in a first manner when the reproduced content isdetermined to be shared with the communication target apparatus and in asecond manner which is different from the first manner when thereproduced content is determined not to be shared with the communicationtarget apparatus, so as to provide a visual indication to a user as towhether or not the reproduced content is being shared with thecommunication target apparatus, in which in the first manner thecaptured image and the image represented by the reproduced content arearranged so as to appear to be in a virtual space on the display, and inwhich in the second manner the captured image and the image representedby the reproduced content are arranged in different regions on thedisplay without appearing to be in the virtual space.
 2. The controlapparatus of claim 1, wherein the reproduced content also representsaudio and in which the processor is configured to add an invertedcontent audio signal to the audio represented by the reproduced content.3. The control apparatus of claim 2, wherein the inverted content audiosignal is obtained by inverting a phase of the audio represented by thereproduced content.
 4. The control apparatus of claim 1, wherein theprocessor is configured to mask the image represented by the reproducedcontent.
 5. The control apparatus of claim 4, wherein the processor isconfigured to mask the image represented by the reproduced content byremoving a portion of the image represented by the reproduced content.6. The control apparatus of claim 4, wherein the processor is configuredto mask the image represented by the reproduced content by adding amosaic to a portion of the image represented by the reproduced content.7. The control apparatus of claim 1, wherein the generated speech audiosignal shared with the communication target apparatus includes a signalrepresenting speech received from the user of the control apparatus. 8.The control apparatus of claim 1, wherein the processor is configured toadd an inverted speech audio signal to the generated speech audio signalshared with the communication target apparatus.
 9. The control apparatusof claim 8, wherein the inverted speech audio signal is obtained byinverting a phase of a speech signal received from the user of thecommunication target apparatus.
 10. The control apparatus of claim 1,wherein the processor is configured to modify the captured imagereceived by the input unit and to share the modified captured image withthe communication target apparatus.
 11. The control apparatus of claim10, wherein the processor is configured to modify the captured image byreplacing a portion of the captured image with an avatar.
 12. Thecontrol apparatus of claim 1, wherein the control apparatus furthercomprises the display.
 13. The control apparatus of claim 1, wherein thereproduced content also represents audio and in which the processor isconfigured to modify the audio represented by the reproduced content.14. The control apparatus of claim 13, wherein the processor isconfigured to modify the audio represented by the reproduced content byadding a reverberant sound effect to the audio represented by thereproduced content.
 15. The control apparatus of claim 1, where thecontrol apparatus is included in a telephone, computer, set top box,mobile phone, or game machine.
 16. A method for use with a controlapparatus for performing selective content sharing, the methodcomprising: receiving a captured image; establishing communication witha communication target apparatus; reproducing content indicated bycontent data, the reproduced content representing an image; determining,with a processor, whether or not to share the reproduced contentindicated by the content data with the communication target apparatus;selectively performing, in accordance with a result of the determining,a process for sharing or not sharing the reproduced content indicated bythe content data with the communication target apparatus, such that,when the reproduced content indicated by the content data is determinednot to be shared with the communication target apparatus, (i) sharing agenerated speech audio signal with the communication target apparatusand (ii) not sharing the reproduced content indicated by the contentdata with the communication target apparatus, and, when the reproducedcontent indicated by the content data is determined to be shared withthe communication target apparatus, sharing the generated speech audiosignal with the communication target apparatus and sharing thereproduced content indicated by the content data with the communicationtarget apparatus; and causing the captured image and the imagerepresented by the reproduced content to be displayed on a display in afirst manner when the reproduced content is determined to be shared withthe communication target apparatus and in a second manner which isdifferent from the first manner when the reproduced content isdetermined not to be shared with the communication target apparatus, soas to provide a visual indication to a user as to whether or not thereproduced content is being shared with the communication targetapparatus, in which in the first manner the captured image and the imagerepresented by the reproduced content are arranged so as to appear to bein a virtual space on the display, and in which in the second manner thecaptured image and the image represented by the reproduced content arearranged in different regions on the display without appearing to be inthe virtual space.